Monitoring system, monitoring center device, mounting device, monitoring method, processing method, and program

ABSTRACT

A monitoring system in which a mounting device of a moving body and a monitoring center device are connected via a communication network, wherein the mounting device includes a photographing unit configured to photograph a passenger, and a feature transmission unit configured to transmit feature data of the passenger, and the monitoring center device includes a monitoring processing unit which determines whether the feature data is recorded in a database and performs monitoring processing on the basis of a result of the determination.

INCORPORATION BY REFERENCE

The present application is a Continuation application of U.S. patentapplication Ser. No. 17/005,912 filed on Aug. 28, 2020, which isContinuation application of U.S. patent application Ser. No. 15/849,951filed on Dec. 21, 2017, which is based upon and claims the benefit ofpriority from Japanese patent application No. 2017-012731 filed on Jan.27, 2017, the disclosure of which is incorporated herein in its entiretyby reference.

TECHNICAL FIELD

The present invention relates to a monitoring system, a monitoringcenter device, a mounting device, a monitoring method, a processingmethod, and a program.

BACKGROUND ART

A technology aimed at preventing crime using vehicles has been studied.For example, Japanese Unexamined Patent Application, First PublicationNo. 2016-186813 discloses a technology capable of preventing theft ofvehicles such as automobiles and exerting power in arresting a criminalor catching a criminal.

SUMMARY

It is necessary to detect not only theft but various types of crimes inmoving bodies such as various vehicles and to prevent crimes.

An example object of the present invention is to provide a monitoringsystem, a monitoring center device, a mounting device, a monitoringmethod, a processing method, and a program which can solve the aboveproblems.

According to a first example aspect of the present invention, in amonitoring system comprising a mounting device of a moving body and amonitoring center device connected to the mounting device via acommunication network, the mounting device includes a photographing unitconfigured to photograph a passenger, and a feature transmission unitconfigured to transmit feature data of the passenger, and the monitoringcenter device includes a monitoring processing unit which determineswhether the feature data is recorded in a database and performsmonitoring processing on the basis of a result of the determination.

According to a second example aspect of the present invention, amonitoring center device in a monitoring system in which a mountingdevice of a moving body including a photographing unit for photographinga passenger and a feature transmission unit for transmitting featuredata of the passenger, and the monitoring center device are connectedvia a communication network includes a monitoring processing unit whichdetermines whether the feature data is recorded in a database andperforms monitoring processing on the basis of a result of thedetermination.

According to a third example aspect of the present invention, a mountingdevice in a monitoring system in which the mounting device of a movingbody and a monitoring center device are connected via a communicationnetwork includes a photographing unit configured to photograph apassenger, a feature transmission unit configured to transmit featuredata of the passenger to the monitoring center device, and a startcontrol unit configured to acquire, from the monitoring center devicewhich performs monitoring processing on the basis of a result ofdetermining whether the feature data is recorded in a database, a resultof the determination and to control starting of a moving body on whichthe mounting device is mounted on the basis of the result of thedetermination.

According to a fourth example aspect of the present invention, amonitoring method includes determining whether the feature data isrecorded in a database and performing monitoring processing on the basisof a result of the determination, by a monitoring center device in amonitoring system in which a mounting device of a moving body includinga photographing unit for photographing a passenger and a featuretransmission unit for transmitting feature data of the passenger, andthe monitoring center device are connected via a communication network.

According to a fifth example aspect of the present invention, aprocessing method includes photographing a passenger, transmittingfeature data of the passenger to the monitoring center device,acquiring, from the monitoring center device performing monitoringprocessing on the basis of a result of determining whether the featuredata is recorded in a database, the result of the determination, andcontrolling starting of a moving body on which the mounting device ismounted on the basis of the result of the determination, by a mountingdevice in a monitoring system in which the mounting device of a movingbody and a monitoring center device are connected via a communicationnetwork.

According to a sixth example aspect of the present invention, anon-transitory computer-readable recording medium storing a programwhich causes a computer to perform processes of a monitoring centerdevice in a monitoring system in which a mounting device of a movingbody including a photographing unit for photographing a passenger and afeature transmission unit for transmitting feature data of the passengerand a monitoring center device are connected via a communicationnetwork, the processes comprising determining whether or not the featuredata is recorded in a database and to perform monitoring processing onthe basis of a result of the determination.

According to a seventh example aspect of the present invention, anon-transitory computer-readable recording medium storing a programwhich causes a computer to perform processes of a mounting device in amonitoring system in which the mounting device of a moving body and amonitoring center device are connected via a communication network, theprocesses comprising photographing a passenger, transmitting featuredata of the passenger to the monitoring center device, and acquiring,from the monitoring center device performing monitoring processing onthe basis of a result of determining whether the feature data isrecorded in a database, a result of the determination and controllingstarting of a moving body on which the mounting device is mounted on thebasis of the result of the determination.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram of a monitoring system according to oneembodiment of the present invention.

FIG. 2 is a hardware configuration diagram of a mounting deviceaccording to one embodiment of the present invention.

FIG. 3 is a functional block diagram of the mounting device and amonitoring center device according to one embodiment of the presentinvention.

FIG. 4 is a first diagram which shows a processing flow of the mountingdevice according to one embodiment of the present invention.

FIG. 5 is a diagram which shows a processing flow of the monitoringcenter device according to one embodiment of the present invention.

FIG. 6 is a diagram which shows a minimum configuration of the mountingdevice according to one embodiment of the present invention.

FIG. 7 is a diagram which shows a minimum configuration of themonitoring center device according to one embodiment of the presentinvention.

EXAMPLE EMBODIMENT

Hereinafter, a monitoring system, a monitoring center device, a mountingdevice, a monitoring method, a processing method, and a programaccording to one embodiment of the present invention will be describedwith reference to drawings.

FIG. 1 is a schematic diagram of a monitoring system according to theembodiment.

In a monitoring system 100 as shown in FIG. 1, a mounting device 1mounted on a vehicle 10 and a monitoring center device 2 are connectedvia a communication network. The mounting device 1 may communicate andconnect with the monitoring center device 2 using, for example, publicwireless communication, and may communicate and connect with themonitoring center device 2 via a relay device by performing short-rangewireless communication with the relay device wired-connected with themonitoring center device 2 installed at a roadside machine or a positionclose to a traveling road.

FIG. 2 is a hardware configuration diagram of the mounting device. Asshown in FIG. 2, the mounting device 1 includes, for example, respectivehardware constituents such as a central processing unit (CPU) 101, aread only memory (ROM) 102, a random access memory (RAM) 103, a harddisk drive (HDD) 104, a user interface 105, a communication module 106,a camera 107, a Global Positioning System (GPS) receiver 108, and thelike. The user interface 105 is, for example, a liquid crystal touchpanel or a button. The mounting device 1 may be configured to furtherinclude other hardware.

FIG. 3 is a functional block diagram of the mounting device and themonitoring center device.

The mounting device executes a program stored in the ROM 102 or the likeof the mounting device, thereby including each function of aphotographing unit 11, a feature transmission unit 12, a positioninformation acquisition unit 13, a monitoring unit 14, a movementdetection unit 15, a start control unit 16, an image transmission unit17, and a communication unit 18 therein.

The photographing unit 11 included in the mounting device 1 performsphotographing by controlling the camera 107, and generates an image bythis photographing. The photographing unit 11 is installed in a vehicleto photograph a face of a driver of the vehicle and the inside of thevehicle and can photograph moving images and still images.

The feature transmission unit 12 recognizes the face of the driver onthe basis of the image photographed by the camera 107 and obtained bythe photographing unit 11 and extracts feature data of a person. Thefeature data in the present embodiment is data including at leastfeature information on the face of the driver. The feature transmissionunit 12 may extract feature data of the faces of passengers boarding thevehicle in addition to the driver. The feature transmission unit 12transmits monitoring data including the feature data, positioninformation of the vehicle 10 acquired by the position informationacquisition unit 13, time measured by a timer in the mounting device 1to the monitoring center device 2. When the feature data cannot begenerated from an image, the feature transmission unit 12 may requestthe image transmission unit 17 to transmit the image, perform processingto alert the driver, or notify the monitoring unit 14 that the featuredata cannot be generated.

The position information acquisition unit 13 calculates a currentposition of the vehicle 10 on the basis of information included in asignal from a satellite obtained from the GPS receiver 108.

The monitoring unit 14 transmits the feature data to a predeterminedservice device such as the monitoring center device 2. A service devicein the present embodiment is the monitoring center device 2.

The movement detection unit 15 detects that the vehicle 10 has moved onthe basis of acceleration and position information. The movementdetection unit 15 may detect states of a vehicle such as a stoppingstate, a stopped state, and a traveling state. The movement detectionunit 15 can transmit movement states (stopping, stopped, and traveling)of the vehicle 10.

The start control unit 16 acquires a determination result from themonitoring center device 2 according to the transmission of the featuredata to the monitoring center device 2, and controls starting of avehicle on which the mounting device 1 is mounted on the basis of thedetermination result. The start control unit 16, as an example, mayperform control to start a vehicle when two conditions such asperformance of a starting operation of a vehicle using an ignitionswitch or a key, and acquisition of starting permission by themonitoring unit 14 are satisfied.

The image transmission unit 17 performs processing of transmittingimages acquired from the camera 107 by the photographing unit 11. Thecommunication unit 18 communicates and connects with the monitoringcenter device 2.

The monitoring center device 2, like the mounting device 1, is acomputer including hardware such as a CPU, a ROM, a RAM, an HDD, a userinterface, and a communication module. The CPU of the monitoring centerdevice 2 executes a program, and thereby the monitoring center device 2includes each function of a monitoring processing unit 21, a recordingunit 22, a communication unit 25, and a notification unit 26. Inaddition, the monitoring center device 2 includes a qualified persondatabase 23 and a wanted person database 24.

The monitoring processing unit 21 in the monitoring center device 2searches for the qualified person database 23 storing information on adriver's license possessed by a police institution or the like and thewanted person database 24 in which feature data of a wanted person suchas a wanted criminal is recorded. The monitoring processing unit 21collates feature data stored in these databases with feature dataobtained from the mounting device 1 and determines whether they matcheach other. The monitoring processing unit 21 transmits a determinationresult of the collation to the mounting device 1.

The recording unit 22 stores monitoring data including feature data andthe like of a person transmitted from the feature transmission unit 12of the vehicle 10.

The qualified person database 23 holds data of a driver's license, dataof a face photograph of a person on the driver's license, and personalfeature data of the person.

The wanted person database 24 holds data of a face photograph of awanted person such as a wanted criminal and other personal feature data.

The communication unit 25 is a processing unit which communicates andconnects with the mounting device 1.

The notification unit 26 performs processing of notifying apredetermined transmission destination of an abnormality when it isdetermined that there is an abnormality on the basis of the featuredata. The notification unit 26 may transfer the abnormality notificationto the predetermined transmission destination on the basis of anabnormality notification signal from the mounting device 1.

The mounting device 1 and the monitoring center device 2 include suchrespective functions, and thereby it is possible to reliably monitor adriver of a vehicle and to accumulate monitoring information.Accordingly, this can help with investigations and search and rescueoperations of police, firefighting, and the like when there areincidents, accidents, and disasters.

FIG. 4 is a first diagram which shows a processing flow of the mountingdevice.

Next, processing of the embodiment of the present invention will bedescribed in order.

First, a driver performs a staring operation of a vehicle using anignition switch or a key in a cockpit to start the vehicle 10. Thecamera 107 is installed to photograph the face of the driver. Thestarting operation starts the mounting device 1. The photographing unit11 controls a photographing operation of the camera 107 (step S101).Then, the camera 107 starts photographing and outputs photographed datato the photographing unit 11. This photographed data includes data ofthe face of the driver. The photographing unit 11 generates an image onthe basis of the photographed data and output the image to the featuretransmission unit 12.

The feature transmission unit 12 acquires images (step S102). Thefeature transmission unit 12 determines whether feature data of the faceof the driver has been extracted from the image (step S103). The featuretransmission unit 12 determines whether the number of times it isdetermined that the feature data of the face of the driver cannot beextracted reaches a predetermined number (step S104). The featuretransmission unit 12 outputs alert information when No is determined instep S104 (step S105). A case of outputting alert information is a casein which feature data cannot be extracted when the driver's posture isbad or when the driver wears a mask or sunglasses. In addition, thealert information is information prompting the driver to enable personalfeature data to be extracted, and is output by screen display, voice,and the like. If Yes is determined in step S104, the featuretransmission unit 12 cannot recognize a face image or cannot extract thefeature data. For this reason, the feature transmission unit 12transmits the inability to extract the feature data to the monitoringcenter device 2.

If the feature data has been extracted, the feature transmission unit 12instructs the monitoring unit 14 to transmit the feature data. Themonitoring unit 14 acquires information on a current position of thevehicle 10 from the position information acquisition unit 13. Themonitoring unit 14 acquires a current time. The monitoring unit 14transmits monitoring data including at least the feature data, positioninformation, and the current time to the monitoring center device 2 viathe communication unit 18 (step S106). The monitoring unit 14 determineswhether monitoring data has been transmitted. The monitoring unit 14outputs a signal indicating that monitoring data cannot be transmittedto the start control unit 16 when monitoring data cannot be transmitted.

The monitoring unit 14 determines whether a determination result basedon transmission of monitoring data is received from the monitoringcenter device 2 (step S107). The determination result includes variousinformation such as a qualified person flag, a wanted person flag, astill image transmission flag, and a moving image transmission flag. Thequalified person flag is a flag indicating whether a personcorresponding to the feature data has a qualification. The wanted personflag is a flag indicating whether a person corresponding to the featuredata is a wanted person. The still image transmission flag is a flagindicating whether it is necessary to transmit a still image. The movingimage transmission flag is a flag indicating whether it is necessary totransmit a moving image. When Yes is determined in step S107, themonitoring unit 14 analyzes the determination result (step S108).

The monitoring unit 14 analyzes the qualified person flag in analysisprocessing. In addition, the monitoring unit 14 analyzes the wantedperson flag in the analysis processing. In addition, the monitoring unit14 analyzes the still image transmission flag in the analysisprocessing. In addition, the monitoring unit 14 analyzes the movingimage transmission flag in the analysis processing. The monitoring unit14 performs processing based on a result of the analysis (step S109).

Specifically, the monitoring unit 14 output starting permission to thestart control unit 16 when it is determined that the qualified personflag indicates that a person has the qualification. The monitoring unit14 may not output starting permission to the start control unit 16 whenit is determined that a qualified person flag indicates that the persondoes not have the qualification.

When the still image flag is a value indicating that it is necessary totransmit the still image, the monitoring unit 14 instructs the imagetransmission unit 17 to transmit the still image. When the moving imagetransmission flag is a value indicating that it is necessary to transmitthe moving image, the monitoring unit 14 instructs the imagetransmission unit 17 to transmit the moving image. The imagetransmission unit 17 sequentially inputs images from the photographingunit 11. The photographing unit 11 generates the moving image on thebasis of a plurality of images acquired from the camera 107 andtransmits the moving image to the image transmission unit 17. The imagetransmission unit 17 transmits the moving image to the monitoring centerdevice 2 via the communication unit 18 when a transmission instructionof the moving image is acquired. The image transmission unit 17transmits one still image in images constituting the moving image to themonitoring center device 2 via the communication unit 18 when atransmission instruction of the still image is acquired.

After the moving image or the still image is transmitted in accordancewith a determination result from the monitoring center device 2, themounting device 1 receives a monitoring completion signal from themonitoring center device 2. The monitoring completion signal is acquiredby the monitoring unit 14. If the monitoring unit 14 acquires themonitoring completion signal, the monitoring unit 14 outputs startingpermission to the start control unit 16. The start control unit 16outputs a signal for starting a vehicle to an engine control device whentwo conditions such as performance of a starting operation of a vehicleusing an ignition switch or a key and acquisition of starting permissionby the monitoring unit 14 are satisfied (step S110). This starts anengine of the vehicle 10.

As described above, the vehicle 10 can be started when a startingoperation of a vehicle using an ignition switch and a key and monitoringare performed. Accordingly, it is possible to reliably monitor thedriver when the vehicle 10 starts.

When communication between the mounting device 1 and the monitoringcenter device 2 cannot be performed for any reason, the monitoring unit14 may temporarily store the still image and the moving image withouttransmitting them to the monitoring center device 2 on the basis of adetermination result obtained from the monitoring processing unit 21. Inthis case, the monitoring unit 14 may output starting permission of thevehicle 10 to the start control unit 16 without acquiring a monitoringcompletion signal from the monitoring center device 2. The monitoringunit 14 can send the still image and the moving image temporarily storedafter the communication between the monitoring center device 2 and themounting device 1 is restored.

While the vehicle 10 moves, the monitoring unit 14 performs monitoringprocessing again if the operation of the vehicle 10 continues for acertain period of time. A monitoring processing procedure is the same asthe processing shown in FIG. 4. The monitoring unit 14 may not performmonitoring processing when it is determined that the vehicle 10 isstarted but not moving. Accordingly, it is possible to reliably monitorthe driver even when the vehicle 10 is in operation.

FIG. 5 is a diagram which shows a processing flow of the monitoringcenter device.

The monitoring processing unit 21 of the monitoring center device 2performs person authentication using monitoring data transmitted by themounting device 1 (step S501). The monitoring processing unit 21collates feature data extracted from the monitoring data with featuredata recorded in the qualified person database 23 (step S502). Whenmatching feature data is detected in the collation processing of stepS502, the monitoring processing unit 21 stores the feature data and setsthe qualified person flag to a value indicating that a person has aqualification.

In addition, the monitoring processing unit 21 collates the feature dataextracted from the monitoring data with feature data recorded in thewanted person database 24 (step S503). When matching feature data isdetected in the collation processing of step S503, the monitoringprocessing unit 21 stores the feature data and sets the wanted personflag to a value indicating that a person is the wanted person.

If the wanted person flag is set to the value indicating that the personis the wanted person, the monitoring processing unit 21 sets the stillimage flag to a value indicating that it is necessary to transmit thestill image or sets the moving image flag to a value indicating that itis necessary to transmit the moving image. The monitoring processingunit 21 transmits a determination result holding various types of flagsto the mounting device 1 (step S504).

When the qualified person flag included in the determination result is avalue indicating that the person is not the qualified person, and thewanted person flag included in the determination result is a valueindicating that the person is not the wanted person, this indicates thatno feature data is recorded in both the qualified person database 23 andthe wanted person database 24. In this case, the feature data providingthis determination result is feature data not held in the monitoringcenter device 2, and the monitoring unit 14 of the mounting device 1transmits the still image to the monitoring center device 2. Themonitoring processing unit 21 of the monitoring center device 2determines whether a still image is received (step S505). When the stillimage is received, the monitoring processing unit 21 outputs a faceimage and the feature data corresponding to the face image to therecording unit 22. The recording unit 22 records the face image and thefeature data corresponding to the face image in a database (step S506).As a result, monitoring data is stored. As described above, themonitoring unit 14 is requested to add the feature data to be monitoredand the face image. The monitoring center device 2 can reliably monitora driver and further store the monitoring data.

The monitoring processing unit 21 of the monitoring center device 2determines that it is an emergency when the inability to extract featuredata is acquired by the mounting device 1 or when feature data includedin monitoring data is stored in the wanted person database 24. When thefeature data cannot be extracted, there is a possibility that a drivermaliciously refuses monitoring and authentication, and the monitoringprocessing unit 21 can transmit an instruction to strengthen monitoringto the mounting device 1. The monitoring unit 14 of the mounting device1 may instruct the image transmission unit 17 to deliver a moving imagewhen information to strengthen monitoring is received. Accordingly, themonitoring center device 2 can perform real-time monitoring. Inaddition, when the inability to extract the feature data is received bythe monitoring processing unit 21, the notification unit 26 of themonitoring center device 2 may transmit notification informationincluding the face image and the feature data to a device at apredetermined report destination.

By performing such monitoring of a driver, it is possible to expect acrime suppression effect such as hesitation of a crime by a person whodrives. When it can be confirmed by notification information that aperson is a wanted person, it is possible to contribute to the arrestsof wanted persons by notifying an investigation institution andstrengthening monitoring on the vehicle 10 as described above.

In addition, when feature data is recorded in the qualified persondatabase 23 by collation processing, the monitoring processing unit 21may record information such as suspension of a driver's license, licenseinvalidation, and an unauthorized vehicle in correlation with thequalified person information of the qualified person database 23. Withthis processing, it is possible to detect an obvious driving violation.In this manner, this processing can be used in catching a violation.

The monitoring center device 2 can ascertain a situation in which adriver is a learner on a temporary license, a foreigner who drives arental car, or the like when feature information is not recorded in anydatabase according to a result of performing collation processing usingtwo databases of the qualified person database 23 and the wanted persondatabase 24. In this case, the monitoring center device 2 can requestnot only the feature data of a driver but also the face image of thedriver to the mounting device 1, and store and monitor monitoring dataincluding the face image.

By constructing a monitoring system with the mounting device 1 and themonitoring center device 2, it is possible to expect an effect of crimeprevention. In addition, monitoring data such as face images and storedfeature data can be searched by a person and person feature information,and this can help with tracking, investigating, and searching for andrescuing persons of interest. Therefore, it is possible to detect andprevent various types of crimes in addition to theft in a moving bodysuch as various vehicles.

The monitoring unit 14 of the mounting device 1 may permit starting ofthe vehicle 10 even in a situation in which communication with themonitoring center device 2 is not possible. In addition, the monitoringunit 14 may request the feature transmission unit 12 to transmitpersonal feature data when the vehicle 10 continuously runs for acertain distance or more on the basis of state information of thevehicle 10. Moreover, when notification that the feature transmissionunit 12 cannot extract personal feature data is continuous, it ispossible to determine that it is an emergency, and it is possible tonotify the monitoring center device 2 that it is an emergency.

When feature data of a driver is recorded in the wanted person database24, the notification unit 26 can notify a predetermined device to thateffect as an emergency. In addition, the monitoring processing unit 21can instruct monitoring strengthening such as continuous photographingand transmission of moving images and transmission of still images tothe mounting device 1. For example, when feature data of a driver isrecorded in the qualified person database 23 and the feature data of thedriver is recorded in the qualified person database 23 in accordancewith information on license suspension, the monitoring processing unit21 can notify a device possessed by a predetermined institution to thateffect via the notification unit 26.

In addition, the monitoring processing unit 21 can instruct themonitoring unit 14 to strengthen monitoring such as transmission ofstill images. For example, when the monitoring processing unit 21 isnotified that it is an emergency by the mounting device 1, themonitoring processing unit 21 can notify a predetermined device to thateffect via the notification unit 26. Moreover, the monitoring processingunit 21 can instruct the monitoring unit 14 to strengthen monitoringsuch as transmission of still images.

FIG. 6 is a diagram which shows a minimum configuration of the mountingdevice.

The mounting device 1 as shown in FIG. 6 may be a device including atleast a photographing unit 11, a feature transmission unit 12, and astart control unit 16.

FIG. 7 is a diagram which shows a minimum configuration of themonitoring center device.

The monitoring center device 2 as shown in FIG. 7 at least includes amonitoring processing unit 21 which determines whether feature datareceived from the mounting device 1 is recorded in a database, andperforms monitoring processing on the basis of a result of thedetermination.

The whole or part of the example embodiments disclosed above can bedescribed as, but not limited to, the following supplementary notes.

SUPPLEMENTARYNOT (Supplementary Note 1)

In a monitoring system comprising a mounting device of a moving body anda monitoring center device connected to the mounting device via acommunication network, the mounting device includes a photographing unitconfigured to photograph a passenger, and

a feature transmission unit configured to transmit feature data of thepassenger, and the monitoring center device includes a monitoringprocessing unit configured to determine whether the feature data isrecorded in a database and to perform monitoring processing on the basisof a result of the determination.

(Supplementary Note 2)

The monitoring system according to Supplementary note 1 in which themonitoring processing unit transmits a determination result to themounting device on the basis of the determination result, and themounting device includes a start control unit which controls starting ofa moving body on which the mounting device is mounted on the basis ofthe determination result.

(Supplementary note 3)

The monitoring system according to Supplementary note 1 or Supplementarynote 2, in which the monitoring center device includes a recording unitfor recording the feature data.

(Supplementary note 4)

The monitoring system according to Supplementary note 3, in which thefeature transmission unit transmits a time at which the feature data isextracted from an image generated by photographing the passenger andposition information of the moving body together with the feature datato the monitoring center device, and the recording unit records thefeature data, the time, and the position information in correlation witheach other.

(Supplementary Note 5)

The monitoring system according to any one of Supplementary note 1 toSupplementary note 4, in which the mounting device includes a movementdetection unit for detecting a movement of the moving body, and thefeature transmission unit transmits the feature data to the monitoringcenter device on the basis of detection of a movement of the movementdetection unit.

(Supplementary note 6)

The monitoring system according to any one of Supplementary note 1 toSupplementary note 5, in which the monitoring processing unit of themonitoring center device determines whether there is an abnormality inthe monitoring processing on the basis of the determination result, andthe monitoring center device further includes a notification unit for,when it is determined that there is an abnormality, notifying apredetermined transmission destination of the abnormality.

(Supplementary Note 7)

The monitoring system according to Supplementary note 4, in which themonitoring processing unit of the monitoring center device requests themounting device to continuously transmit the feature data, the time, andthe position information when it is determined that there is anabnormality in the monitoring processing on the basis of a result of thedetermination.

(Supplementary Note 8)

A monitoring center device in a monitoring system in which a mountingdevice of a moving body including a photographing unit for photographinga passenger and a feature transmission unit for transmitting featuredata of the passenger and the monitoring center device are connected viaa communication network includes a monitoring processing unit whichdetermines whether the feature data is recorded in a database andperforms monitoring processing on the basis of a result of thedetermination.

(Supplementary Note 9)

A mounting device in a monitoring system in which a mounting device of amoving body and a monitoring center device are connected via acommunication network includes a photographing unit configured tophotograph a passenger, a feature transmission unit configured totransmit feature data of the passenger to the monitoring center device,and a start control unit configured to acquire, from the monitoringcenter device which performs monitoring processing on the basis of aresult of determining whether the feature data is recorded in adatabase, a result of the determination, and to control starting of amoving body on which the mounting device is mounted on the basis of theresult of the determination.

(Supplementary Note 10)

A monitoring method includes determining whether the feature data isrecorded in a database and performing monitoring processing on the basisof a result of the determination, by a monitoring center device in amonitoring system in which a mounting device of a moving body includinga photographing unit for photographing a passenger and a featuretransmission unit for transmitting feature data of the passenger and themonitoring center device are connected via a communication network.

(Supplementary Note 11)

A processing method includes, by a mounting device in a monitoringsystem in which the mounting device of a moving body and a monitoringcenter device are connected via a communication network, photographing apassenger, transmitting feature data of the passenger to the monitoringcenter device, and acquiring, from the monitoring center device forperforming monitoring processing on the basis of a result of determiningwhether the feature data is recorded in a database, a result of thedetermination and controlling starting of a moving body on which themounting device is mounted on the basis of the result of thedetermination.

(Supplementary Note 12)

A non-transitory computer-readable recording medium storing a programwhich causes a computer to perform processes of a monitoring centerdevice in a monitoring system in which a mounting device of a movingbody including a photographing unit for photographing a passenger and afeature transmission unit for transmitting feature data of the passengerand a monitoring center device are connected via a communicationnetwork, the processes comprising determining whether or not the featuredata is recorded in a database and to perform monitoring processing onthe basis of a result of the determination.

(Supplementary Note 13)

A non-transitory computer-readable recording medium storing a programwhich causes a computer to perform processes of a mounting device in amonitoring system in which the mounting device of a moving body and amonitoring center device are connected via a communication network, theprocesses comprising photographing a passenger, transmitting featuredata of the passenger to the monitoring center device, and acquiring,from the monitoring center device performing monitoring processing onthe basis of a result of determining whether the feature data isrecorded in a database, a result of the determination, and controllingstarting of a moving body on which the mounting device is mounted on thebasis of the result of the determination.

The mounting device 1 described above has a computer system inside. Aprogram for causing each device to perform the processing describedabove is stored in a computer readable recording medium of each of thesedevices and a computer of each device reads and executes this program toperform the processing described above. Here, the computer readablerecording medium refers to a magnetic disk, a magneto-optical disc, aCD-ROM, a DVD-ROM, a semiconductor memory, and the like. In addition,this computer program may be delivered to a computer via a communicationline, and the computer receiving this delivery may execute the program.

In addition, the program may realize some of functions of respectiveprocessing units described above. Further, the program may be aso-called difference file (difference program) which can realize thefunctions described above in combination with a program already recordedin a computer system.

While preferred embodiments of the invention have been described andillustrated above, it should be understood that these are exemplary ofthe invention and are not to be considered as limiting. Additions,omissions, substitutions, and other modifications can be made withoutdeparting from the spirit or scope of the present invention.Accordingly, the invention is not to be considered as being limited bythe foregoing description, and is only limited by the scope of theappended claims.

What is claimed is:
 1. A control device for a moving body, the controldevice comprising: a first starting means for controlling starting themoving body based on a predetermined input; and a second starting meansfor controlling the starting the moving body based on the predeterminedinput and authentication using a captured image.
 2. The control deviceaccording to claim 1, wherein the captured image is acquired from aphotographing device installed on the moving body.
 3. The control deviceaccording to claim 2, wherein the photographing device is installed at aposition where an inside of the moving body is captured.
 4. The controldevice according to claim 1, wherein the authentication is performedbased on feature information of a person in the captured image.
 5. Thecontrol device according to claim 1, wherein the starting of the movingbody by the first starting means is permitted when predeterminedcondition is satisfied.
 6. The control device according to claim 5,wherein the predetermined condition is a case where the authenticationusing the captured image cannot be performed.
 7. The control deviceaccording to claim 6, wherein the authentication using the capturedimage is performed through communication with an external device, andthe predetermined condition is satisfied when the communication with theexternal device is not possible.
 8. A control system comprising: acontrol device for a moving body; and a monitoring device, wherein thecontrol device includes: a first starting means for controlling startingthe moving body based on a predetermined input; and a second startingmeans for controlling the starting the moving body based on thepredetermined input and authentication using a captured image in themonitoring device.
 9. A control method for a moving body, the controlmethod comprising: controlling starting the moving body based on apredetermined input; and controlling the starting the moving body basedon the predetermined input and authentication using a captured image.